A framework for SPMD applications with load balancing
نویسندگان
چکیده
This work describes SAMBA, a framework for the development of parallel SPMD applications with load balancing. SAMBA contains the structure common to different SPMD applications and a library of loadbalancing algorithms. This structure allows the developer to concentrate on the specific problem at hand. The load-balancing library makes easier the identification of the most appropriate strategy for a given application. Experiments conducted with SAMBA on three different parallel applications are described, illustrating the ease of use of the proposed framework and the relevance of load balancing. Keywords— SPMD, load balancing, framework, data parallelism, parallel programs.
منابع مشابه
Load Balancing Algorithms for SPMDApplications ?
This paper deals with the problem of load balancing in SPMD parallel applications. Based on the study of recent work in the area, we propose a taxonomy that provides a terminology and a framework for describing and classifying the growing number of SPMD load balancing algorithms. This allows more thorough and systematic comparison studies of diierent load balancing techniques, helping designers...
متن کاملA Scalable Dynamic Load-Balancing Algorithm for SPMD Applications on a Non-Dedicated Heterogeneous Network of Workstations (HNOW)
Network based distributed computing has become a cheap alternative to dedicated parallel supercomputer systems due to the recent advances in high-speed network. These systems are becoming widely available in academic and industrial environments. To benefit from the maximum computation power of these systems, it is necessary to use all available resources, namely old machines in addition to more...
متن کاملCheck-load Interval Analysis for Balancing Distributed SPMD Applications
This paper aims at improving the performance of parallel applications running on nondedicated distributed platforms through a dynamic load balancer which is kept hidden to the programmer. The support periodically checks the status of the platform and, if necessary, redistributes portions of the data domain from overloaded to underloaded nodes. Various experimental results pointed out the depend...
متن کاملA Load Balancing Schema for Agent-based SPMD Applications
Agent based applications are used for large simulations of complex systems. When large number of agents and complex interaction rules are required, an HPC infrastructure can be helpful for executing such simulations in a reasonable time. However, complex interaction rules usually cause workload imbalances that negatively affect the simulation time. In this paper, we propose a load balancing sch...
متن کاملFLEX-MPI: An MPI Extension for Supporting Dynamic Load Balancing on Heterogeneous Non-dedicated Systems
This paper introduces FLEX-MPI, a novel runtime approach for the dynamic load balancing of MPI-based SPMD applications running on heterogeneous platforms in the presence of dynamic external loads. To effectively balance the workload, FLEX-MPI monitors the actual performance of applications via hardware counters and the MPI profiling interface—with a negligible overhead and minimal code modifica...
متن کامل